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ABSTRACT ; > ^ * 

The discrepancy approach, with a; nonionotonic 

function, was used in. a questionnaire designed to lea sure the 
'^difference between, reality as^^^^ and desires. Reality is 

described as a student's perception of teacher, perfbriance and notion 
of an ideal teacher performance* The questionnaire deals with both 
the intensity and direction of a student's dissatisfaction with 
his/her teacher. An experiient, utilizing 1,059 students fro« 52 
classes in seven different French colleges, was designed to ■easure 
the construct validity of this questionnaire. Results are presented- 
in tables entitled: (1) Content descriptions, peans' and standard 
deviations of five constructs for each of 15 iteis, as well as the 
percentage of excess discrepancies; (2) Precision coefficients for a 
direct Measure of dissatisfaction and for four dpnstructs associated 
with a derived ■easure of dissatisfaction; (3) Observed correlations 
between five constructs used in the derived approach and direct 
■easure of the satisfaction-dissatisfaction continuuw; (4) 
Corelations for reliability attenuation; and (5) Observed aean within 
groups correlations between four constructs used in the derivation 
procedure and a direct aeasnre of the satisfaction-dissatisfaction 
contincua. It is concluded that desires should be thought of as a 
continuui with limits being respectively the ideal and the ■ininally 
acceptable* (BJG) ? ^ 
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INTRODUCTION 



In 1967, one of us, then a professor of psychology in a 
Montreal college, used parts of his free time to construct with 
some of his students a course evaluation questionnaire intended for 
local use. The idea of using a disi^^repancy measure came neither 
from the litterature nor from a desire to verify a particular theo- 
retical model, but from a pragmatic problem the group encountered. 

The research team initially considered using a S-pbint 
scale to measure directly the satisfaction-dissatisfaction continuum. 
But, since the questionnaire had a fair nmnber of items in which sa- 
tisfaction appeared related non-monotpni.caily to reality, the direction 
of the dissatisfaction feeling, in terms of deficiency or excess, was ' 
deemed as in5)ortant to measure as its intensity. This was the case 
for instance with items jneasuring the frequency of examinations, the 
quantity of conq)ulsory readings, the speed in speech delivery, etc^ 
It was deemed even plausible that some teachers could be judged too 
patient, too humble or modest, too prone to htimor, or else that some- 
courses could be judged excessively structured. 

Looking for a simple procedure that would allow us to measure 
simultaneously the intensity and direction 'of student dissatisfaction, 
we devised an indirect or "derivation" approach, which rests essen- _ 
tially upon c m'iasure of the discrepancy between reality as perceived 
and desires. From the relative position on a same scale of both 
measures we would identify the direction we were looking for, while 
the distance between them would give us the intensity of the dissatis- 
faction feeling. This procedure, developed intuitively by the research 
team, had already been tried, as we discovered later. In fact, well 



before us, a few researchers had proposed or experimented discrepancy 
models similar to ours, in order to measure job satisfaction in indus- 
trial settings. Locke (1969) as well as Wanous and Lawler (1972): have 
reviewed extensively these efforts. CloseV to our interests, Savage 
(1957), Gage, Runkel and Chatter jee (1960) -and Thomas C1969) have used 
a fairly similar procedure in experiments designed to verify the 
Influence of feedback as a means to change the behavior of teachers. 
But none of these authors seems to have noticed the advantages of this 
approach as applied to items in^ which satisfaction is a non-monotonic 
jEunction of reality. 



DESCRIPTION OF THE DERIVATION PROCEDURE 



How does our procedure work? Figure 1 shows a typical item, 
as presented in the most recent form of the questionnaire, together with 
the Instructions given to the respondents. 

A short description of the attribute to be measured is accom- 
panied by a 7-point scale. Our research ,( All aire, 197A) has shown this 



Question A: Where do you place this course (this teacher) on 
the evaluation' scale? - 

If you are satisfied, mark question B at the same 
point on the scale as you have chosen for question A. 

Question B: IF YOU ARE NOT SATISFIED, where should the course 
(the teacher) be placed on the scale so that you 
would be satisfied? 



31. This course is struc- 
tured (the teacher 
follows a detailed plan). 



extremely 



a 

little 



to a to a 
certain very great 



1 


2 


3 


4 


5 


6 


7 





Figure 1. Typical format and answering 

instructions in the SPOT questionnaire. 



scale length to be significantly more reliable than a 5-point scale 
(cf« data sources H-I and H-II in Table 4). Four of the seven points 
are anchored vith frequency Cv.g. never - always) or intensity (v«g. 
very little - to a very great degree) qualificatives, depending on 
which are better adapted to the specific contents. As shown in the 
same figure, respondents are asked to answer two questions, item * 
after item; we first ask about their perception of reality and, second, 
about the level deemed desirable for that particular attribute. 

Fron^ the answers given to these only two questions, we com- 
pute at_Uie_class__level six measures for each item, as shown in 
table 1. The first construct, called /MAS that is the mean of this 
answers to question A, represents the teaqher's actual behavior as 
perceived- by his group of students. The construct labelled 'MB* 
reflects the* students • desires and, by its relative position to MA, 
signals the direction of desired change. 

The last four constructs are related to dissatisfaction. 
First, the construct labelled ^7.^ siii5)ly gives the percentage of 
students assumed to be dissatisfied because their A answer differs 
from their B answer. Secondly, the construct called VMAB* cumulates 
the absolute values of the discrepancies; thence, it indicates only 
the magnitude of the dissatisfaction expressed by students. On the 
other hand, the construct labelled •MAL^ (AL for algebraic) takes 
into account the direction of the discrepancies, so that, within 
a class, discrepancies in opposite directions will cancel each other. 
For this reason, we call this measure the •^NET dissatisfaction score". 
Its sign specifies if the residual majority dissatisfaction corres- 
ponds to a deficiency or an excess. Finally, the construct called 
•PCD* only makes clear, in terms of percentages, the difference between 
MAB and MAL, that is the degree of contradiction within the sub-group 
of dissatisfied students. 

In order to give a more lifelike picture of thesi constructs, 
we present in Table 2 an interpretation of fictitious scores obtained 



Table 1 



Description of the six main constructs confuted for each item 
'in the PERPE-SPOT Questionnaire 





' Code 


Formula 


— ■ — ■ — — ■ r— — 

Construct description 




MA 


J1(A answers )/N students 


Level of teacher behavior as perceived^ In- 




terpreted by means of scale anchors. 




MB 


ECB. answers )/N students 


Level of student desires • Interpreted by 




Percentage of dissatisfied students, tnat is 




% 


rf(A ^ B) * 100/N 


those students whose perceptions of reality 
differ from their desires • - _ 

Gross dissatisfaction score. It is the sum 




MAB 


S(l A - b|)/U 


of the absolute discrepancies, divided by all 
respondents^ dissatisfied or not. It inidir. 
cates the intensity Mevel of the dissatisfac- 
tion felt in the group as a whole • It may ^ 
vary from 0.00 to 6.00, but ^rarely exceeds 
3.00. : ^ ^ - 








Net dissatisfaction score. ^ It is the alge- 




MAL 


^ E(A - B)/N 


braic sum of the signed discrepancy^ di- 
vided by all respondents dissatisfied or 
noti When ali subjects have answered A and 
B, MAL = MA - MB. Also, MAL ^ MAB, since 
dissatisfactiohs in opposite directions 
wi1:hin the class will cancel each other. 
Since most item scales are ascending from 1 
to. 7 in terms of frequency, or intensity, the 

sign of the M^ will usually cbrrespond. , 
to a deficiency and the sign to' an ex- 
cess of the attribute measured. Same rai^e 
as above. : ^ - v — ; 

Percentage of wi thin-group contradiction. 




. PCD 


(MAB - jMALj) * 100/MAB 


07o « all discrepancies in the same 
direction 
100% « half of the discrepancies in 
each direction 
50% « one-fourth of the discrepancies 
in a direction opposite to the 
other three-fourths. 
Note: PCD has been up to now the most 

•'forgot ten" construct in our research. 
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Analysis of fictitious results obtained by 
two instructors on the saj^le item presented in Figure 1 



RESULTS 


Instructor 
or class 




MA 


MB 


7. 


MAB 


MAL 


PCD- 


X 




4.15 


4.80 


457. 


.70 


-.65 


077. 


Y 




6.50 


6.20 


637. 


.70 


+.30 


57% 



In the light of data gathered in thousands of classes, we can certify 
that these fictitious results are quite plausible. By placing the intensity 
construct (MAB) at the same level in both classes, we vish to show how dif- 
ferently two identical dissatisfaction measures can be interpreted through 
our^ other constructs. \ - 

^ a) To a same degree of dissatisfaction correspond quite different 

reality^ (MA) and desires (MB) measures . The degree of structure in course Y 
is. perceived as much higher than In group X. Moreover, students in group X 
appear also to desire a higher degree of structure in their particular learning 

situation. ^ v - : - . ; \ ^ -^ ^^ 

b) To a same degree of dissatisfaction correspond different percentages 
of dissatisfied students: this means that among the dissatisfied students .more 
of them give discrepancies greater than i ^ group X (where % is lower) than 
in group Y. Since % (in decimals) is always equal or smaller than MAB, the 

^ larger the difference between them, the greater the frequency of discrepancies 
larger than 1 among dissatisfied students. In other terms, by comparing these 
two measures, we can tell if a given difference is due to a large goup of midly 
dissatisfied students or to a smaller but more dissatisfied group. 

c) To a same degree of dissatisfaction correspond quite different NET 
dissatisfaction scores (MAL). In fact, group X signals a deficiency in course 
structure (MAL = -.65). as compared to an excess signalled by group Y (MAL = +.30). 
The lowering of the dissatisfaction intensity from MAB to MAL in group Y is 

due to a large degree of contradiction between dissatisfied students pertaining 
to the direction of the change desired; in fact, PCD shows that more than a 
fourth of these students would like a more structured course, even though the 
majority judges the course as already too structured. 

In conclusion, without the information given by these measures, and 
taking into account the fact that students generally desire "well"-structured 
courses, the instructor in group Y, given only an evaluative judgment (v.g. MAB), 
might believe that there is a deficiency in course structure. Moreover., he 
would not be aware of a lack of agreement between his students as to the direction 
of the desired change. Finally, he would not know the actual degree of structure 
of his course as perceived by his students. 
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by two instructors on the item shown in Figure !• 

To the best of our knowledge, the PERPE-SPOT Questionnaire^^ 
appears, to be the very first, and still the only, widely circulated 
questionnaire using a discrepancy approach to measure student per- 
ceptions of courses* Approximately four thousand college instructors 
in the province of Quebec have used the french form in the past seven 
years, and a few hundreds more, in Quebec and. other provinces, have 
Administered the english form* The richness of the information pre- 
sented seems to allow for a more elaborate pedagogical diagnosis,^ . 
which helps to make up for the longer administration time and the 
greater effort required on the part of the in3tructor to master the 
jmeaning of -the different constructs* — . 



THE MAIN PROBLEM: CONSTRUCT VALIDITY 

Because of repeated requests from teachers, the PERPE-SPOT 
Questionnaire was ojEfered in all Quebec colleges well before we had 
completed our program of research* Among other things, we did not 
have definitive empirical evidence pertaining to the underlying as- 
sun^)tions of this measuring technique* Since our procedure appeared 
to be unique as compared to similar questionnaires used elsewhere, 
it was to be expected that we would take special interest in the va- 
lidation of the constructs presented above, specifically those related 
to the concept of satisfaction* The main problem w^s, of course, to 
verify if our discrepancy measure did in fact correspond to a direct 
expression by students of their degree of satisfaction* 



PERPE stands for 'Terceptions E^tudiantes de la* Relation Prof esseur-. 
Etudiants"; SPOT stands for "S^tudents* P^erceptions £f Teachers"* 
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As it became clear to us that it would not be possible to 
present in sufficient detail more than one of the studies made in 
tUe recent years, the present authors decided to focus on our most 
recent experimental study^, specially designed to collect data on 
the above problem. . 



METHOD j / 

" - - • ~ t 

The 1059 subjects in this experiment came from 52 classes 
in seven different french colleges* All subjects were presented two 
forms of a course evaluation questionnaire. There were 15 items in 
both questionnaires! chosen from a group of 75 items that were being _ 
tested in the framework of a forthcoming revision of the PERPE-SPOT 
Questionnaire. In form X, we used the derived approach described- 
Tabove, the only difference being in a 5-ppint scale anchored with 
appropriate qualif icatives on each of the five points. In form Y, 
the items were slightly reworded so as to be more congruent with the 
direct scale used to measure the satisfaction-dissatisfaction ciontinuum 
(cf. Figure 2). To check for a possible effect due to the sequence 





1 


2 * 


3 


4 


5 


6 




very 
dissa<- 
tisfied 


dissa- 
tisfied 


slightly 
dissa«- 
tisfied 


slightly 
satis- 
fied 


satis- 
fied 


very* 
satis- 
fled 




To* what degree are you 


satisfied 








^07. 


...of his ability to explain 
ideas? 


clearly difficult concepts and 



Figure 2. Typical item and instructions from the expe- 
rimental form using a direct measure of satisfaction. 



We wish to thank Miss Lucie Houde, M. Rene Beausejour and Professor 
Richard Brunet for their close collaboration in the planning and ^ 
data collection stages of this study. 
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of presentation, two sub-groups of 4 classes were each presented 
with a particular sequence*/ The litem x sequence* ANOVA revealed 
no particular effect beyond what would be expected by chance. The 
sequence of presentation was varied randomly in the last 44 classes, 
with the same sequence for all students of a given class* Data were 
gathered during the 1974 spring s/emester* 



RESULTS 



" Basic statistics 

As a general information on the "behavior" of each item. 
Table 3 presents the mean and standard deviation (N = 52 classes) of 
the five constructs included in the analysis of results* A short 
description of the item contents also appears.. We have placed in the 
right-hand column of Table 3 the percentage pf the observations cor- 
responding to excess discrepancies, that is discrepancies with a 
sign* This datum was chosen as our index of the degree of non- 
monotonicity of the items* You will recall that npn-monptonic items 
may generate excess dissatisfaction as v;ell as deficiency dissatis- 
faction, since the optimally desirable frequency of the behavior 
measured is^ anywhere but at the extremes of the* scale* 



Reliability indices 

The reliability coefficients presentee in this section were ; 
all con5)uted with the same uniform procedure* The basic formula ori- 
ginates from the ANOVA technique (Winer, 1962, pp* 124-132)* It gives 
internal consistency coefficients which can be interpreted in the 
same manner as those obtained through split-halves on classes* Our 
procedure also includes a correction for variati9ns in the number of 
respondents per class (Ebel, 1951, p* 413)* Moreover, in order to 
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facilitate con5)arisons between samples, all coefficients are "stan- 
dardized" on 25 judges with the Spearman-Brown formula. The coeiEfi- 
cients thus computed Indicate the degree of precision with which 

« 

the score of a professor on a given item can be reproduced, whatever 
the group of 25 student judges invited to evaluate an identical learning 
situation. Finally, means across items are computed via r 
transformation. 

The reliability coefficients in the first row of Table 4 
were computed on a subsample of the 1059 subjects, randomly extracted 
in order to carry out an aa-^lysis of variance. The other coefficients 
in Table 4 bear evidence to the similarity of these coefficients as 
compared to those obtained from earlier data banks. 

Except for MB, all coefficients coutpare quite well with si- 
milar indices found in the litterature (Costin, Greeriough and Menges, 
1971, pp. 512-513). In the present study, the D construct appeared 
significantly more precise than the corresponding derived construct 
^SlAB D " ^'^^^ pX.Ol). However, a much smaller difference would 
probably have been observed if a 7-point scale instead of a 5-point 
scale had been used in the derivation- approach, as witnessed by the 
difference in precision between data sources H-I and H-II. 

The lower coefficients for the desire measures (MB) could 
be due to the more subjective character of these measures and to lower 
between group variances (cf. Table 3). It might seem surprising that 
these precision coefficients were nevertheless relatively high, con- 
sidering what we would expect from "subjective" measures. Our results 
clearly show that student desires, at least as measured by our tech- 
nique, do vary systematically from one class to another. These 
results, and others in the same direction, have led one of us (Gagne, 
1973) to adopt for the MB measures the terms "circumstancial desires", 
that is desires pertaining to specific learning situations. 
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Convergence between constructs 

Instructor or class level: observed correlations 

As already told, MA, MB, MAB, MAL and D measures were com- 
puted for each item in each of the 52 groups, using the formulae pre- 
sented in Table 1. Then, in order to answer the following question: 
"Which of the constructs from the discrepancy procedure is most 
closely related to a direct measure of the satisfaction-dissatisfaction 
continuum?", we computed, item by item, correlation coefficients between 
the D measure on one part and each of the other constructs, adding to 
the group the absolute value of MAL (!mAL|). We wanted to verify 
whether this construct was as good a predictor of D as MAB» If so, 
we could henceforth forgo the use of MAB, since MAL would serve to 
convey at the same time the intensity and direction of the dissatisfaction 
feeling*. TKese five series of correlation coefficients appear in Table 5* 
In this table, the items are ordered according to their decreasing degree 
of non-monotonicity» Using Fisher's transformation applied to the 
absolute 'r* values, means across items were separately computed for 
the four clearly non-monotonic items, the remaining eleven and the 
total group* 

The mean correlations appearing on the bottom row of Table 5 
confirm, for the tptal group of items, the superiority of MAB as a 
predictor of direct satisfaction (7 = .86). The absolute values of 
MAL come second (T = •82); then, at the same level, we have MA and - _ 
MAL (7 = •78) and, far behind, MB with a mean correlation of •38^ 
But, if we compare the respective average correlations for the eleven 
monotonic and four non-monotonic items, it becomes clear that the 
general superiority of MAB over the other constructs is explained in 
large part by a drastic lowering of MA and MAL correlations in the 
case of non-monotonic items • These low MA and MAL correlations were 
expected, since with non-monotonic items satisfaction is first an 
increasing, then a decreasing function of behavior frequency or in-^ 
tensity • As for the MALs in absolute values, their correlations,- 
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regularly lower than those for MAB, bring us to the conclusion that 
the cancelling process of opposite sign discrepancies has had a 
definite effect; consequently, MAL should not be substituted for 
MAB to measure the intensity of the dissatisfaction feeling* 

The mean correlations of the eleven monotonic items, for 
which excess discrepancies are necessarily rare, show that reality 
(MA) as well as both discrepancy measures (MAB and MAL) are equally 
good predictors of direct satisfaction (r = •SS, .86 and .83) m The 
closeness of MAB and MAL is quite normal, since both measures become 
perfectly correlated when all discrepancies have the same sign» On 
the other hand, the equivalence of MA and MAB as predictors of D 
seems to contradict the theoretical assumption underlying the^ use 
of a derivation procedure, namely that satisfaction should be better 
approximated by taking into account both reality and desires instead 
of reality alone» 

To our judgment, this observed equivalence does not neces- 
sarily imply that desires are useless for predicting satisfaction nor 
that MA and MAB are equally valid measures of the satisfaction construct. 
Their respective reliability levels (cf. Table'4) rather suggest that 
MA owes much of its equivalent standing with MAB to its higher pre- ^ 
cision coefficients* 

Instructor or class level: disattenuated correlations 

To verify whether the above observations would still hold in 
the absence of any measurement error, the correlation coefficients pre- 
sented in Table 5 were corrected for attenuation^* The disattenuated 



To correct for attenuation, we did not use the precision coefficients 
presented in Table 4* These coefficients, which consider as error 
variance systematic differences between students, would be appropriate 
only if the two measures (direct and derived) had come from different 
students* In our case, as all students in each class received both 
questionnaires, the correlation coefficients would be over-corrected* 

(continued on page 15) 
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correlations appear in Table 6, together with the medians of the 
eleven monotonic and the fifteen items# From these last medians 
emerges a pattern of relationships between the PERPE-.SPOT constructs 
and the direct measure of satisfaction that is quite similar to the 
observed correlations presented in Table 5. But, for the sub-group 
of eleven monotonic items, the previously mentionned equivalence 
between MA and MAB gives place to a slight superiority of MAB over 
MA, judging by their respective medians of •97 and •93. This dif- 
ference seemsj to confirm the hypothesis we made earlier: MAB is 
related to satisfaction more intimately than reality, but since the 
difference is small in the case of clearly desirable items, its 
better validity may be masked by its lower reliability as compared 
to MA. 

Besides allowing for a conparison between MAB and the other 
constructs, the data in Table 6 also make possible the estimation of 
the absolute, rather than relative, degree of convergence between the 
derived and direct measures of satisfaction. In fact, these disat- 
tenuated correlations correspond to the maximum correlations we would 
obtain if our measures were perfectly reliable; this would be the 
case for example if the instructors had been evaluated by an infinite 
number of students. Then, a median disattenuated correlation of .94, 
as computed between MAB and the direct measure, leads us to conclude 
that these two measures share on the average 947o of their true variance. 
The fact that only 6% of the true variance of MAB for a typical item 
is not reproducible on the direct measure confers on our derived cons- 
truct a degree of convergent validity which appears, if not perfect, 
at least quite impressive. 



So, the error variance estimates used in the present correction were 
obtained from the ANOVA (N=460) mentionned earlier; they correspond 
to that part of the within-instructors variance which is not repro-* 
ducible from one method to the other (cf. Cronbach et al«, 1972, p. 288). 
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Table 6 



Same correlations as in table 5 (except for |14Al|), 
but corrected for reliability attenuation 



Item 


MA 


MB 


MAB . 


MAL 




43 


-17 


.87 


.91 


HQ 


-.76 


.22 


.91 


.87 




07 


• fc.-' 


.92 


.01 ' 


03 


.65 


.34 


.78 


.88 


05 


.84 


.94 


>1.00 


.64 


10 


.91 


.77 


>1.00 


.76 


12 


.96 


.66 


.96 


.89. 


13 


.87 


.43 


.89 


>1.00 


11 


.93 


.55 


>1.00 


.81 


04 


.70 


.17 


■ .84 


.79 


. 01 


>1.00 


.75 


.89 


.87 


07 


>1.00 


.45 


?1.00 


.99 * 


14 


.88 


.35 


.98 


>1.00 


08 


.96' 


.51 


.94 


.•96 


02 


.99 


.51 


.97 


.97 


. Medianj^j^ 


.93 


.51 


.97 


.89 


Median 


.88 


.45 


.94 


.88 
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Respondent level: within groups correlations 



The last series of results, presented in Table 7, are si-» 
milar to the correlation coefficients given in Table 5, except that, , 
rather than being computed with class means as observationr>, they 
were computed. within each class, using individual student answers^ 
We wanted to ascertain from these data vrtiether the pattern of re- 
lationships between the PERPE-SPOT constructs and the direct measure 
still reappeared when these constructs were used to measure differen- 
ces in satisfaction between students of a given instructor, instead 
of differences in '*satisf actoriness" between instructors* 

The different groups of average correlations show a pattern 
strikingly similar to those in previous tables* For non-monotonic 
items, the reality measure is clearly inferior to the absolute dis- 
crepancy measure (.IG vs .AS), while the algebraic discrepancy measure 
occupies an intermediate position (•28)« In the case of monotonic- 
items, reality comes out on a par with the absolute discrepancy measure 
(•42 vs •AS), but the algebraic discrepancy measure remains slightly 
inferior (•40) to both of them^ Obviously, these correlations are 
Tower than in Table 5, since they were computed from less precise 
individual answers^ It would have been interesting to see if, when 
corrected for attenuation, these correlations keep their relative 
status^ We would also have been able to verify with these disatte- 
ntiated correlations whether we obtain with the individual measures 
a degree of maximum convergence as reassuring as the level obtained 
with class scores^ Unfortunately, the design of the present experiment 
did not permit us to estimate the error pf measurement in student answers • 
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Table 7 



Observed mean within groups correlations (N=:52) betv;een four constructs , 
used in the derivation procedure (A,B>A-.B,( A-B | ) and a direct 
measure of the satisfaction-dissatisfaction continuum 





A 


B 


(A - B) 


(|a - b|) 


Item 


0 


0 


0 


0 


15 Frequency of lecturing 
09 Compulsory readings 
06 Speed in speech delivery 
03 Workload (light - heavy) 


-.03 
.22 

-.12 
.24 


.33 
.06 
.05 
.03 


.27 
.21 

:::i5 

.24 


.42 
.42 
.52 

.43: 


Mean : 


.154 


.120 




.449: 


-05 Particular about use of language 
10 Questions to verify understanding 

12 Frequency of group -work 

13 CarefuL not to hurt students 

04 student participation in grading 

01 Motivates to invfstigage further 

07 Clarity of explanations 
. 14 Showmanship 

08 Frequency of humour 

02 Monotonous lively 


.36 
.26 

34 

.44. 

.21 

.55 

.50 

.42 

.49 

.62 


.25 
' -.04 

-.12 
.32 
.24 

-.10 
.20 
.11 

-.05 
.06 
.18 

/ 


.12 
.31 
.43 
.19 
.28 
.29 
. .42 
.45 
.44 
142 
.42 


. .18 
.42 
.52 : 
.32 
.19 
.33 
.43 
.47 
.45 
.50 
.49 


Mean: 


.431 


.153 


.347 


.396 ■ 


Over-all Mean: 


.362 


.144 


.313 


7 .411 ; 
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DISCUSSION Aim CONCLUSIONS 

We -have found three studies^ in which one of the main objec- 
tives was the validation of a discrepancy model through its comparison 
V7ith a direct measure of satisfaction. 

Other studies 

Let us first mention Locke (1969), who gives an extensive 
demonstration, based on the objectivist philosophy of Ayn Rand and 
Nathaniel Brendon, of the face validity of a perception-value discre- 
pancy model. Then, as empirical proof for his thesis, he describes . 
briefly a few studies, in two of which (llarbaugh-Farr and Mob ley 
Studies) different aspects of work itself are evaluated through 
direct and discrepancy measures of satisfaction. The derivation - 
procedure uses two questions, presented as we do after each item ; 
>»What is your job like?'* and "What should it be like?". The corre- 
lations obtained appear even more positive than our within groups 
correlations (cf. Table 7). Indeed, while the correlations between 
reality and satisfaction are approximately- .50 (N = 72) ^in both 
studies, the corresponding correlations for the absolute discrepancy 
measure exceed .70, even though the items used look, from the examples 
given, generally monotonic^. 

Contrary to Lockers results and ours, Wanpus and Lawler (1972), 
as well as Levinthal (1974), obtain negative results in their attempts 



Three other studies, Imparato (1972), Sanders and Lynch (1973) and 
Mitchelmore (1973), while loosely related to this topic, are designed 
in a manner which precludes any comparison with our results. 

These results would be similar, to ours if his items were shown to- 
be in fact non-monotonic. 
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to verify similar hypotheses. - On the one hand, Vlanous and Lawler, 
with a questionnaire comprising 23 job facets, most of them clearly 
desirable, measure in turn: a) reality (is Now); b) what is deemed 
equitable (Should be)j c) what is deemed desirable. (Would Like), 
d) importance; e) satisfaction. Their results show clearly that, 
on the average, the direct satisfaction measure (e) is more closely 
related to reality (v = .60) than to either of the two algebraic 
discrepancy measures, computed from the "Would Like" answers (r = .44) 
or the "Should Be" answers (r =.36). _ 

As for Levinthal (1974), he administered in two classes 
(N = 69 and 123) a course evaluation questionnaire, whose items 
were mostly monotonic. For all items, he collects, in turn , reality 
measures, ideal measures (Should Be), as well as an evaluative judgment 
on a 5-point scale increasing from "1. outstanding" to "5. poor". 
Averaged over ten items, the correlation between the absolute discre- 
pancies (D measures) and the evaluative judgments (E) is respectively 
.25 and .22 in each group, while the corresponding average correla- 
tions between reality (0) and E are .52 and .46^. 

The "boRRing of the question" problem 

How can we explain such a large divergence between these two 
couples of studies? The answer which strikes us first focuses on the 
procedures adopted. On the one hand, Wanous and Lawler, as well as 
Levinthal, measure the two basiQ constructs (reality and desires) 
separately, while Locke and ourselves ask both questions simultaneously 
for each item. Our procedure goes one step further, since our ins- 
tructions make clear to the respondents the interpretation which we 
will give to the discrepancy between both answers. ' 



Note that these two pai'rs of correlation coefficients may be compared 
"mutatis mutandis" to the average ^A-B vs and •A vs correlations 
given in Table 7. 
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By so doing, we will probably be "accused" of "begging 
the question", since we inform the respondents about the derivation- 
process we v;ish precisely to validate* This objection, logically 
unassailable, would shift the validation problem from MAB, v;hich 
is now clearly validated, to MB, the construct most liable to 
"manipulation" so that the resulting discrepancy will be coherent 
with the dissatisfaction feeling. However, the above objection 
would loose most of its weight if it was demonstrated that the two 
constructs directly measured, that is reality and desires, suffer 
no discemable bias due to their juxtaposition or to our instructions. 
Now, a study by one of our colleagues (Houde, 1974), while conducted 
-^n only two classes, shows a total lack of significant differences 
between A answers, measured separately or as part. of o\ir derivation 
procedure; within the B answers, a few significant differences appear, 
but still not large enough to speak of a net bias. Anyway, we intend 
to do further research in that direction. Let us note finally that 
Lockers clearly more "neutral" procedure is nonetheless open to the 
above objection; it appears quite plausible that the simple fact of 
placing side by side the two questions could be sufficient to draw 
the respondent's attention to the "common sense" relationship which 
unites reality, desires and satisfaction. 

Even though the "begging of the question" objection does 
reduce the significance of our positive results., it does not explain 
for all that the negative results obtained through a procedure not 
subject to that objection. Do Wanous and Lawler's as well as Levinthal 
results reflect more precisely the validity, or rather the invalidity 
of a more strictly derived measure? In Levinthal' s research report, 
we were able to look at his data much more throughly than those of 
Wanous and Lawler. From this analysis, we submit that his I question 
(ideal or desires) was probably not interpreted univocally by all 
vstudents, thus seriously jeopardizing his results; 

In order to illustrate our forthcoming demonstration, we 
present in Table 8 some of the results pertaining to the first two 
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Table 8 



D vs E and 0 vs E correlations for all subjects and for sub-groups 
at each level of I, as obtained with items 08 and 14 in 
experiment OEIII (from Levinthal, 1974, pp. 44 and 48) 





Total 
Sample 




Levels 


of I-score 






1 


2 ■ 


3 


4 


5 


should generate excitement about 


subj ect being thought 






r (D,E) 


.43 


.62 


.25 


-.64 






n 


(121) 


(74) 


(38) 


(7) 


(2) 


(0) 


r (0,E) 


.61 


.63 


.50 


.65 






n 


(121) 


(75) 


(37) 


(7) 


(2) 


(0) 


Should be 


dynamic and outgoing 










r (D,E) 


.21 


.57 


-.05 


-.37 






n 


(120) 


(41) 


(59) 


(16) 


(1) 


(0) 


r (Oj E) 


.62 


.57 


.61 


.63 _ 






n 


(119) 


(41) 


(59) 


(16) 


(2) 


(0) 



items of his questionnaire (cf. 1974, pp. 44 and 48, experiment OEIII). 
The data shown are the correlation coefficients between the "direct" 
measure CE) and the discrepancy measure (D), as well as the 0 (reality) 
vs E correlations. They are given for all subjects and for each sub- 
group having cliosen a different I answer. The number of respondents 
appears inside parentheses. Taking into account the clear desirability 
(or undesirability) of most of his items, we were first surprised by 
the large proportion of students (approximately 507o across items) who 
placed their "ideal", or more precisely their "Should Be" answer, any- 
where but at the endpoint of the frequency scal.e. For instance, it 
seems strange that 13% of the respondents (cf. Table 8) answer that 
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their instructor should be (ideally) "occasionnaly dynamic and outgoing". 
Levinthal interprets these dispersions as real differences between 
student ideals (1974, p. 17). 

We rather believe that they reflect divergent interpretations 
of the "Should Be" question. In our opinion, most or the students 
using point 1 (almost always) interpret the question as "Should be 
Ideally" , most of the students using point 3 (occasionnaly) interpret 
this same question in terms of "Should be ^at least" > while the respon- 
dents at point 2 (often) could either use the above interpretation, 
or even one similar to our own B question, that is "Should be#.. so 
that I would be satisfied". As proof of the above assertion, we 
will use the D vs E correlations given in Table 8, which change dras- _ 
.tically in sign and value according as they come from students using 
points 1, 2 or 3 of the I-scale. The negative correlations appeared, par- 
ticularly mysterious to Levinthal, while they are quite simply explained 
with our assumptions. For instance,, for those students who have used 
the "ideal" interpretation and consequently have probably chosen 
point 1, any observed answer below that point will generate negative 
discrepancies, that is dissatisfaction. Thus, the greater the discre- 
pancy, the greater the dissatisfaction, which is coherent with the 
positive correlations observed. But,. for those students using point 3 _ 
on the I-scale, which we assumed to be a "minimally acceptable" answer, 
reality answers placed at points 1 or 2 will mean a frequency level 
higher than the minimum desired; then, these I-O positive discrepancies 
must be interpreted as a "surplus of satisfaction" ; consequently, the 
correlations will be negative, meaning precisely: "the larger the 
.discrepancy, the greater the satisfaction" ^. Finally, we can assume 



The change in sign but not in value between the D vs E (-.64) and 0 vs E 
(+.65) correlations for subgroup 1=3 on the first item in Table 8- cons- 
titutes a mathematical proof that all discrepancies (O-l) in that par- 
ticular sub-group had a positive sign. 
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for point 2 a probable mixing of both interpretations > which would 
explain the frequently low correlations observed for this point. 

In our judgment, these divergent interpretations of the 
I-scale largely explain the low D vs E correlations computed with 
total sample data since, according to their sign, the absolute 
discrepancy measures have opposite meanings. 

Even though we do not have much information to discuss 
the Wanous and Lawler study, because of the similarity in the proce- 
dure used, it appears vulnerable to the same kind of criticism* 
Consequently, from these negative results, as well as from Lockers 
and our own positive results, we cannot conclude definitely whether 
a discrepancy model allows for a valid measure, not only of satis- 
faction, but also of reality and desires. 

Conclusion 

Most of the above discussions pertaining to our data and 
tl jse of our colleagues seem finally .to converge on the same problem: 
the nature of the construct, generally called desires, which accom- 
panies the reality measure in a derivation procedure. One thing is 
clear to us: desires are not to be thought of as a specific point 
which we are progressively trying to encircle, but as a continuum, 
its limits being respectively the ideal and the minimally acceptable. 

Since the terms -'would like", "should be" and "prefer" do 
not represent specific points on this continuum, but are as many 
synonyms to describe the continuum itself, v/ith what terms are we 
left to describe specific points, other tluvA the two extremes? Could 
it not be possible that there is no choice, if we wish to describe 
an intermediate point, but to allude more or less directly to satis- 
faction? In fact, are not the words "minimally acceptable", and 
oven "ideal", related more than implicitly to the idea of satisfaction? 
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Going a little further, could we not even say that the desires con- 
tinuum is nothing else but a satisfaction continuum, since it varies 
from a minimum satisfaction to an infinite degree of satisfaction? 
This is by and large the gist of our curretit reflexions? 
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